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ABSTEACT 


A nonlinear stationary homogeneous digital filter DlRSIT (De- 
rivative Information Recovery by a Selective Integration Technique) 
is investigated. The spectrum of a quasi-llnear discrete describing 
function (DDF) to DIRSIT is obtained by a digital measuring scheme. 

A finite Impulse response (FIR) approxima tlon to the quasi-linearlza- 
tlon is then obtained. Finally, DIRSIT is compared with its quasi- 
linear approximation and with a standard digital differentiating tech- 
nique. Results indicate the effects of DIRSIT on a wide variety of 
practical signals. 
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!♦ INTRODUCTION 


This research is intended to supply information on the effects 
of DIRSIT (Derivative Information Recovery by a Selective Integration 
Technique) on practical signals. This Information is obtained by de- 
veloping a discrete describing function (DDF) . 

DIRSIT is a nonlinear homogeneous stationary digital filter 
used to reduce data contaminated by gaussian noise and shot noise [4] 
[5]. The early investigators found that DIRSIT has almost complete 
immunity to noise spikes and can track the second Integral of a step 
function with very little error. Unfortunately, little is known of 
the effect of this filter on practical signals. What Information is 
available is limited to specific input functions, and is qualitative 
and empirical [4], [5]. 

The describing function is a traditional method to "describe" 
nonlinear systems. The describing function is the transfer function 
of a quasi-linearization of the nonlinear system [1]. The quasi- 
linearization has the property that its output is as close as pos- 
sible (in some defined sense) to the output of the nonlinear system 
for some specific set of input functions. 

The describing function method is useful as a description pro- 
vided the nonlinear system is "almost linear" in the region of inter- 
est. A system is "almost linear" on a set of input functions (de- 
noted *S'), provided that the system almost obeys linear superposi- 
tion over S; that is, the output of the system for an input consist- 
ing of any finite sum of functions from S, is "close" to the sum of 



the outputs for each Individual input. Traditionally, two functions 
are **close’^ if the root mean square of their difference is small. 

This is the topology used throughout this paper. How close the sys- 
tem must come to obeying linear superposition depends upon the appli- 
cation. 

The sinusoidal describing function is a describing function 
where the set S consists of sinusoids. The output of the sinusoidal 
quasl-linear approximation is the closest linear approximation to the 
output of the nonlinear system. Thus, by Fourier theory, the quasi- 
linear output is the fundamental component of the nonlinear output 
[1]. The describing function of a linear system, then, is the trans- 
fer function of that linear system. The sinusoidal describing func- 
tion began as a heuristic extension of the linear system transfer 
function concept. It is an input amplitude dependent version of a 
system transfer function. Measurement of the describing function 
is feasible only if the system is homogeneous (amplitude indepen- 
dent) . 

The discrete describing function (DDF) developed here is anal- 
ogous to the continuous sinusoidal describing function. As in the 
continuous case, the DDF is a quasi-linear approximation to the given 
system. The output of the quasi-linearization for a sampled sinu- 
soidal input is the ’’fundamental component” of the system output. 

The quasi- linear approximation minimizes the mean-square difference 
between the actual and the approximate output for a sampled sinu- 
soidal input . 
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The concept of a describing function to ’’describe’* a discrete 
system is not new. In 1959, Ben C. Kuo introduced what he called the 
"2-transform-descrlblhg function" [2]. The Z-transform-describlng 
function for a discrete nonlinear element is defined as the ratio of 
the Z-transform of the output from the element, to the Z-trans£orm of 
the input to the element. The input to the nonlinear element is re- 
stricted to a specific function; in most cases, that function is a 
sampled sinusoid. The Z-transform-describlng function may be used in 
the standard linear analysis technique to replace the nonlinear ele- 
ment with no approximation errors, provided that the exact input to 
the nonlinear element la known a priori. Dr. Kuo was able to utilize 
this technique to analyze the behavior of a feed-back loop containing 
a relay. 

The discrete describing function (DDF)* developed here may also 
be used in evaluating discrete nonlinear feedback systems. The pro- 
cedure would be to substitute the DDF for the nonlinear element in 
the standard linear analysis technique. An advantage in using the 
DDF is that the exact input need not be known. A single analysis is 
valid for a rather wide range of Inputs to the nonlinear element. A 
disadvantage in using the DDF is that there is an approximation being 
made. This problem may be circumvented by using a "remnant" genera- 
tor in much the same way as is done in the continuous case , but this 
would then reduce to the Z-transform-descrlbing function approach. 

The use of the DDF to evaluate discrete systems is similar to 
the use of the sinusoidal describing function to evaluate continuous 
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systems. The evaluation of a nonlinear system in this context is a 
frequency description of the input output relation of the system. 

This description is necessarily limited, and valid only on the set S 
where the system is almost linear. The use of the DDF in this paper 
will be limited to this type of evaluation of discrete systems. 

A vector space approach is used to sample the DDF. The vector 
space approach utilizes the projection theorem [3]. This is possible 
since the quasi— linear output is the "best" (closest) linear approxi- 
mation to the nonlinear system. An algorithm is developed to obtain 
samples of the frequency response of a quasl-linear approximation to 
any homogeneous (or almost homogeneous) discrete system. These sam- 
ples are then used to realize an approximation to the quasi-lineari- 
zation by the standard 5-T*s method [6]. The projection theorem 
^PP^oach also enables the calculation of how close the quasi— lineari- 
zation is to the system under investigation. Thus, the method pro- 
vides a means of evaluating the results. 

Two simple systems , one linear and one nonlinear , are evalu- 
ated using this technique. The DDF for the linear system turns out 
to be identical to the linear system transfer function as expected. 
The nonlinear system is chosen because it is simple and has an ob- 
vious similarity to DIRSIT. 

Finally, the DDF of DIRSIT is obtained. DIRSIT is then com- 
pared with its quasl-linear approximation and with a standard tech- 
nique of differentiating and smoothing digital data. This results in 
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a greater understanding of the linear and nonlinear effects of DIRSIT 
on a large class of practical signals. 


- 5 - 



II. THE DISCRETE DESCRIBING FUNCTION 

The discrete describing function (DDF) developed here is anal- 
ogous to the continuous sinusoidal describing function. The use of 
the DDF in this paper is limited to that of "evaluating" discrete non- 
linear homogeneous (or almost homogeneous) systems. 

The evaluation of a discrete system by its DDF is similar to 
the evalxiatlon of a continuous system by its sinusoidal describing ■ 
function. The most Important similarity is that the quasi-lineariza- 
tion is the closest linear approximation to the nonlinear system. For 
the continuous case, this means extracting the fundamental component 
from the nonlinear output. This is a consequence of Fourier theory. 
For the discrete case, however, the situation is not so simple. The 
Fourier theory does not apply. The projection theorem is utilized in 
order to provide the existence and uniqueness of the approximation. 

2.1 The Quasi -Linearization 

The quasi-linear approximation to a system is a linear system. 
The linear system is referred to as the quasi-linear system, or quasi- 
linearization (of the approximated system). The impulse response of 
the quasi— linearization is referred to here as the discrete describing 
impulse response (DDIR) , The Z-transform of the DDIR evaluated on the 
unit circle in the complex plane is the DDF of the approximated dis- 
crete system. The DDF for a discrete system is a complex-valued func- 
tion of the real variable w (in units of radians per sample) over the 
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Interval ( ir,Tr], (Recall that the Nyqulst frequency is tt radians per 
sample.) Thus, if h(n) is the impulse response of a quasi-linear 
approximation to a nonlinear system, then h(n) Is the DDIR of that 
system. If H'(z) is the Z-trans£orm of h(n), then H(w) = H'[z = 
exp(jw)] is the DDF of the nonlinear system. The expression H'[z = 
(jw) ] refers to the 2— transform of the system impulse response 
on the unit circle in the complex plane at z = exp (jw) . 

The quasl—linearization minimizes the mean— square difference 
between the actual and the approximate output for a sampled sinu- 
soidal input. The output of the quasi-linearization of a system is 
the closest linear approximation to the output of the system. The 
linear approximation is based on the sampled complex exponentials of 
the fundamental frequency, or equivalently, the sampled sine and co- 
sine functions of the fundamental frequency. 

This may be seen as follows: Let the input to the system and 

the output from the system be of the form, 

f(n) = cos nw (2.1) 

g(n) = a exp(jnw) + b exp(-jnw) + e(n) (2.2) 

respectively, where n ranges over all integers, w ranges over [0,ir], 
j is the square root of -1, and a and b are complex constants. The 
restriction of the range of w is expedient since, by the sampling 
theorem [6], if w is greater than it, aliasing will occur. 
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The complex numbers a and b are obtained by projecting g(n) 
on exp(jnw) and exp(-jnw), respectively, so that the expression 

g’(n) = a exp(jnw) + b exp(-jnw) (2.3) 

represents the closest linear approximation to g(n) based upon exp(Jnw) 
and exp(— jnw). These basis functions form an orthonormal set (ONS) . 
They are chosen because the sampled complex exponential is an eigen- 
function for all linear discrete systems. Since the input (Eq. 2.1) 

Is a linear combination of the basis functions, the response to f(n) 
in Eq , 2.1 from a linear discrete system must also be some linear 
combination of the basis functions. In other words, for an input of 
the form (Eq. 2.1), this basis set spans the space of all possible 
outputs from any linear system. Thus, g* (n) is the "best" linear 
approximation to g(n). 

By using Eq. 2.3, Eq. 2.2 may be rewritten in the form 

g(n) - g' (n) + e(n) (2.4) 

The function e(n) is orthogonal to g’ (n) and therefore contains the 
nonlinear part of g(n). The magnitude of e(n) is a quantitative 
measure of the size of this "nonlinear part". The ratio of the mag- 
nitude of e(n) to the magnitude of g’(n), a function of frequency. 

Is defined here as the error ratio function (ERF) . The ERF is a 
measure of the relative portion of the nonlinear part of g(n). If 
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the value of ERF is much less than one, then the system exhibits a 
small nonlinear effect on its input. If the value of ERF is not small, 
then the system exhibits a large nonlinear effect on its sampled sinu- 
soidal input. In many applications, the ERF could conceivably be util- 
ized to determine whether or not the DDF is an adequate ’’description” 
of a nonlinear element. 

If a discrete homogeneous stationary system is ’’almost linear” 
on some region of sampled sinusoids, then the ERF on that region is 
small. This may be seen as follows: Let the input to the system be 

f(m) = exp(jmw) (2.5) 

and denote the corresponding output by 

g(m) = h(w,m) (2.6) 

Since the system is stationary, it follows that the response to 


f(m) - exp[j(m + n)w] 

(2.7) 

g(ra) = h(w,m + n) 

(2.8) 


for all n. Since the system is homogeneous, it follows that the re- 
sponse to 

f(m) = exp(jnw) exp(jmw) 
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is 


g(m) = exp(jnv) h(w,m) (2.10) 

But the Inputs of Eqs. 2.7 and 2,9 are Identical, so that the corre- 
sponding outputs of Eqs. 2.8 and 2.10 must also be Identical. For the 
particular case where m = 0, this latter Identity becomes 

h(w,n) = h(w,0) exp(Jnw) (2.11) 

Thus the response to Eq, 2.5 may be written 

g(m) = h(w,0) exp(jmw) (2.12) 

Now, suppose the system is "almost linear" at w, that is, with respect 
to exp(jnw) and exp(-jnw). It follows that the response to the input 
function of Eq. 2.1 is given by 

g(n) = i;h(w,0) exp(jnw) - h(-w,0) exp(-jnw)]/2 + e(n) (2.13) 

where e(n) is small. Thus, the desired conclusion is established! 

Wherever the system is almost linear, its ERF is small. This result 
can easily be extended to "almost homogeneous" systems. 

It must be remembered that the converse of the above result is 
not necessarily true. If a nonlinear system exhibits small nonlinear 
effects over a range of input frequencies, it does not follow conclu- 
sively that the system is "almost linear" for these frequencies. This 
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is due to the fact that without further assumptions about a nonlinear 
system, the individual outputs of particular functions are, in general, 
no Indication of what the outputs of their sum will be. Thus, the ERF 
is a quantitative measure of how nonlinear a system is, i.e. , where 
the quasi-linear approximation is a good one, and also Indicates the 
frequency range where the system may be "almost linear". 

In many practical cases in general, and in the systems examined 
in this paper in particular, it is assumed that the ERF is an adequate 
indication of where the system is almost linear. In general, it seems 
that it Is possible to determine where a system Is almost linear only 
by building the set of candidates by trial and error. However, where 
a homogeneous system exhibits a nonlinearity that effects primarily 
frequencies well outside the region of Interest, it seems reasonable 
to assume the ERF is an Indication of where the system is almost lin- 
ear. It is well to remember, however, that what frequencies the "non- 
linear character" of the system effects is a matter of experience and 
judgment of the user. 

Use will be made of two more results about the quasi-lineariza- 
tion. First, the quasl-llnearlzatlon exists; and second, the DDIR is 
real. These results are assumed in most continuous discussions about 
describing functions. Thus, since they are probably somewhat obvious, 
only a rather brief argument for them will be given here. 

The existence of the quasi- linearization follows from the exis- 
tence part of the projection theorem. Whenever the input to a discrete 
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system is of the form of Eq. 2.1, and the output is periodic, then the 
output can be put in the form of Eq. 2.2. This is a direct consequence 
of the fact that the ONS basis used to generate g'(n) in Eq. 2.3 is 
finite, and therefore generates a closed subspace. 

The quasi-llnear response to an input of the form of Eq. 2.1 may 
always be put in the form of Eq, 2.3. But a and b are the values of 
the DDF at w and -w, respectively (since the representation of g'(n) is 
unique!). It will be shown in the next section that b = a*. Thus, the 
DDF exhibits an even real part and an odd imaginary part . But this is 
equivalent to forcing the DDIR to be real! Note that the fact that 
g(n) can be put in the form of Eq. 2.2 again follows from the projec- 
tion theorem. 

The projection theorem, then, provides the means to obtain the 
unique "best" linear approximation to a system with a sampled sinusoi- 
dal input. This "best" linear approximation is the quasi-llnear ap- 
proximation. The projection theorem also provides a quantitative 
method to evaluate this approximation. 

2.2 Sampling the DDF 

The value of the DDF for a specific frequency may be obtained 
by projecting the sampled sinusoidal response of that system on the 
corresponding sampled complex exponential. The coefficient of the pro- 
jection, a complex number, is half the value of the DDF at that fre- 
quency. For example, if the system has the input given by Eq. 2.1, and 
an output given by Eq. 2.2, then the value of the DDF of that system 
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at w is 2a, This may be demonstrated by explicitly solving for a and 
b in Eq* 2.2, and relating the results to the known behavior of dis- 
crete linear systems.. 

The solution of a and b in Eq. 2.2 is given by 

a = (g(n), exp(jnw)) 
b = (g (n) , exp (-jnw) ) 

= [ (g (n) , exp (jnw) ) ] * 

= a* (2.14) 

wherein indicates the complex conjugate. A short account of the 
vector space used in this paper and its associated inner product is 
given in Appendix I. Using the results of Eq. 2.14, Eq. 2.3 may be 
written in the form 


g*(n) = Re [2 a exp (jnw)] (2.15) 

Any linear discrete system with an input of the form 

x(n) = exp (jnw) (2.16) 

has an output of the form 

y(n) = H’[z = exp(jw)] exp(jnw) (2.17) 
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In Eq. 2.17, H' denotes the Z-transform of the impulse response of the 
system. If the input to the system is given by 

x(n) = exp(-jnw) (2.18) 

then the output is given by 

y(n) - H'fz = exp(-Jw)] exp(-jnw) (2.19) 

Thus, since the input function of Eq. 2.1 is a linear combination of 
Eqs. 2.16 and 2.18, the output must be the same linear combination, so 
that the response to an input of the form of Eq. 2,1 is given by half 
the sum of the outputs of Eqs. 2.17 and 2.19. Since the discrete 
homogeneous linear system under consideration is assumed to have a real 
impulse response (which Implies a Z-transform that exhibits complex 
conjugate symmetry), the output from the system for the input of Eq. 

2.1 can be written 

y(n) = 2Re(H'[z = exp(jw)] exp(jnw)) (2,20) 

Utilizing the notation H(w) = H’[z - exp(jw)], Eq. 2.20 may be 
written in the form 


y(n) = Re[H(w) exp(jnw)] (2.21) 

This result in connection with Eq. 2.15 yields the conclusion 
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that 


DDF(w) = 2 a (2.22) 

for w In (0,u). Since the DDIR Is real, its Z-transform has complex 
conjugate symmetry, so that the values of DDF(w) for negative w can be 
obtained from knowing DDF(w) for positive w. In particular, the mag- 
nitude of the DDF is even and the angle (phase) is odd. 

Combining Eqs. 2.22 and 2.14 yields the results 

DDF(w) = 2(g(n), exp(jnw)) (2.23) 

for w in the open region (0,7r). For the special case where w = 0 and 
w = TT, the input function of Eq, 2.1 is a constant. The ONS basis 
consists, under these circumstances, of a single constant, so that 
the value of the DDF for these cases is given by 

DDF(w) = (g(n),l) (2.24) 

The two expressions of Eqs. 2.23 and 2.24, together with the symmetry 
relations, theoretically give a complete recipe for the evaluation of 
the DDF. 

Applying these expressions, however, presents immediate practi- 
cal difficulties. The inner product in Eq. 2.23 can never be calcu- 
lated in practice since it involves knowing g(n) for all integers n. 

A windowing procedure of some sort must be used on the terms involved 
in Eq. 2.23 to approximate the solution. There are two cases to 
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consider: when 2it/w Is rational and when it is not. 

Suppose that 2tt/w Is rational, l.e., there exists two integers, 
say N and K, such that Nw = 2irK, Th6n, if the input is of the form 

x(n) = cos[(n - k)w] (2.25) 

for some Integer k, it follows that x(n + N) = cos[(n + N + k)w] = 
cos[(n + k)w + Nw] = cos[(n + k)w] = x(n) , i.e., x(n) is periodic of 
period N. In this case, the inner product of Eq. 2.23 reduces to a 
finite sum. This assumes the range of the summation covers a "repre- 
sentative region". (See Appendix I.) 

The other case to consider is when 27t/w is irrational. In 
this case, the input iis not periodic. The procedure then is to choose 
N such that the approximation by truncating the sum will be small. 
Intuitively, the sequence is "almost periodic" (i.e., x(n) is close to 
x(n + N) for all n) , when there exists two Integers N and K such that 
wN is nearly 27tK. Then the finite sum may be utilized, except that an 
approximation is being made. 

Thus far, then, the frequency response of the quasi-lineariza- 
tion at w radians per sample is obtained (or approximated) by input- 
ting f(n) in Eq. 2.1, n = 0, 1, ..., N = 1 for an N where Nw is ex- 
actly (or approximately) a multiple of 2ir. 

Unfortunately, the solution of one problem presents another. 

If an input to the system under' study is to be finite, the system, 
being in general nonlinear, will exhibit transient response. This 
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response is not to be considered part of its legitimate output , since 
for a true sinusoidal input , transient response is nonexistent . The 
solution could be any of several. The solution chosen here was to 
input the sequence for a fixed number of inputs, assuming a priori, 
that would exhaust transients. Note that the derivation of Eqs. 2.15 
and 2.21 are valid if n is replaced by n - k throughout, where k is an 
arbitrary integer, so that Eq, 2.22 is still valid, and Eq. 2.23 takes 
the form 

DDF(w) = 2(g(n - k) , exp(jnw - jkw)) (2.26) 

Equation 2.24 may be written 

DDF(w) = (g(n - k),l) (2.27) 

Thus, the value of the DDF(w) for w in the range between zero 
and IT may be calculated with a finite sum given by Eq. 2.26. This 
calculation is accurate for frequencies whose ratio to 2ir is rational 
and otherwise an approximation. The negative frequencies may be ob- 
tained from the positive ones through S3mimetry relations. 

2.3 Approximating the Quasi-Linearization 

The results of following the above recipe will yield, at best, 
discrete samples of the Z-transform of the impulse response of the 
quasi-linearization. There remains the problem of converting these 
samples into usable information. The approach used in this study is 
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to sample the frequency response of the system at even intervals a 
power of 2 times. This allows a situation where the ratio of the 
samples frequency and 2n is always rational and where the periodicy 
of the sequences is well within the range of the computer memory. 

Thus, no error need be introduced at that point. This also allows a 
power of 2 samples of the frequency response of the quasi-linearlza- 
tion to be available. This is exactly the number of samples necessary 
to utilize the F?T algorithm, which Is implied in the 5-T^s method of 
realizing a FIR filter. (See Appendix II.) 

The final algorithm to realize an approximation to the quasi- 
linearization of a discrete system is now complete. Sample the fre- 
quency band a power of two times. For each frequency sample, input a 
fixed number of samples of the sinusoid of that frequency in the sys- 
tem to dissipate any transients. Then input one. period of samples. 
Project the system response on the corresponding sampled complex expo- 
nential (via Eqs. 2.26 or 2.27). This coefficient is the value of the 
DDF at that frequency sample. This result is a power of 2 samples of 
the frequency response of the quasi-linearization. Next step is to ap- 
ply the 5-T’s technique to realize an approximation to the quasi-linear- 
ization. The resulting approximation may then be used to operate on an 
input signal via the fast convolution techniques [6]. This may then be 
compared to the response of the system under study in order to deter- 
mine what effect the nonlinearity has on the input signals. The pro- 
cess also provides a technique for evaluating the accuracy of the re- 
sults. 
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III. THE ANALYSIS OF TWO DISCRETE SYSTEMS 

Two homogenous discrete digital systems are evaluated to Illus- 
trate the use of the DDF technique. The first system Is a simple 
linear system, included to illustrate the fact that the technique will 
reproduce a linear system. The second system is a nonlinear system. 
This system is included to illustrate the use of the DDF technique on 
a nonlinear system. 

For each system, the DDF is sampled evenly on the interval 
(-• rjir]. There is a sample at 0 and it, and 255 evenly spaced samples in 
the open Interval from 0 to it. Thre is, then, a total of 512 samples 
on (-rT,TT]. When the frequency response is plotted, only points from 0 
to TT are plotted , since negative frequencies obey symmetry relations . 

3.1 The Analysis of the Linear Example 

The linear system is a simple averager. The output at a point k 
is the average of the kth input point together with the previous 8 in- 
put points. The output may be written in the form 

g(k) = [fCk) + f(k - 1) + ... + f(k - 8)]/9 (3.1) 

The impulse response of this system is identically zero except for the 
zeroth to the eighth point inclusive, where it has the value of 1/9. 

The DDF of the impulse response is a sin(x)/x type curve that has been 
wrapped around upon itself. 

The DDF of a linear system is obtained using the developed 
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measuring technique. The DDIR of a linear system is the impulse re- 
sponse of that system. The DDF of a linear system is the Z-transform 
of the system impulse response evaluated on the unit circle in the 
complex plane. These facts can be seen by inspecting Eqs. 2.2 and 2.3. 
Recall that the orthonormal basis functions exp(jnw) and exp(-jnw) span 
the space of possible outputs from a linear system and that g’(n) in 
Eq. 2.3 was obtained by projecting the system output g(n) in Eq. 2.2 on 
that space. Thus, for a linear system, g(n) will be in the space and 
the closest approximation to it will be itself. The ERF is expected to 
be nearly identically zero. 

The results of the measurements made on the linear "averager" 
are contained in Fig. 3.1 to Fig. 3.3, Fig. 3.1 is the measured DDF 
of the "averager". The measured DDF (Fig. 3.1) Indeed resembles the 
sin(x)/x curve. The absolute error function is displayed in Fig. 3.2a. 
The ERF is displayed in Fig. 3.2b, The spikes occurring approximately 
at even Intervals are due to the fact that the ERF is the ratio of the 
magnitude of the "nonlinear part" to the magnitude of the "linear part" 
of the system output, and the magnitude of the "linear part" is nearly 
zero at these frequencies (see Fig. 3,1), causing machine overflow. 

The IDFT of the measured DDF was obtained and plotted in Fig. 3.3. 

Fig. 3.3a shows the impulse response of the linear system exactly to 
at least three places. Fig. 3,3b is included to show the imaginary 
part to be null within the order of the errors expected in computing 
the IDFT. Thus, the measured DDF description is very close to the lin- 
ear transfer function description. 
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Fig. 3.1b. The measured DDF of the averager. 

The phase, shown here, is linear. 
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Fig. 3.3b, The measured DDIR of the averager. The 

imaginary part, shown here, is negligible. 
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3.2 The Analysis of the Nonlinear Example 


The nonlinear system extracts the median of a set of 9 points. 

For reference purposes , this system will be referred to here as "LITTLE 
DIRSIT". The output of LITTLE DIRSIT at a point k is the median of the 
set of points consisting of the current (kth) point together with the 
previous eight points. LITTLE DIRSIT is a highly discontinuous system, 
and will pass a square pulse unaffected, provided that its length is 
more than four points. LITTLE DIRSIT was chosen as a nonlinear example 
because it has some obvious similarities to DIRSIT. 

The DDF of LITTLE DIRSIT was measured and is displayed in Fig. 
3.4. The corresponding ERF is plotted in Fig. 3.5. The ERF indicates 
that the "description" is rather good for frequencies zero to about .6 
radians per sample. There are other regions that are good but this 
region will serve to Illustrate the position taken here; Fig. 3.4 in- 
dicates that over these frequencies, LITTLE DIRSIT behaves much like 
the linear "averager”, except that it has some "notches" in the fre- 
quency band. Fig. 3.6 is a plot of the real part of the DDIR of LITTLE 
DIRSIT obtained from the measured DDF samples . The imaginary part of 
the DDIR is negligible. This is a first FIR approximation to the "real" 
DDIR. 

An Important property of the DDIR of this nonlinear discrete 
system is shown in Fig. 3.6. The DDIR is not realizable! The DDIR is 
not identically zero for negative values of the argument n. (Recall 
that the IDFT of samples of a frequency response yield a periodic 
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Fig. 3,5. The ERF for the DDF of LITTLE DIRSIT. 

Note the maximum scale is set at 2.0. 
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**tlme” sequence, so that the second half of the time sequence is the 
same as for negative values of n.) This result seems, prima-f acie , a 
little odd. Note that this does not mean that "LITTLE-'DIRSIT** response 
to an impulse before It is applied. In fact, the response of LITTLE 
DIRS IT to an impulse is null! This result does imply that the quasi- 
linear approximation to LITTLE DIRSIT will respond to an impulse before 
it Is applied. There is, however, no a priori reason to expect a 
quasi-linearization of a nonlinear system to be realizable. 
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IV. DIRSIT 


The discrete system DIRSIT is a nonlinear digital differentia- 
ter. DIRSIT has been used for some time at the University of Utah to 
reduce data contaminated by gaussian noise as well as random spikes . 
DIRSIT is a simple "hammer and tong" technique for obtaining smooth 
estimates of a signal and its first two derivatives, DIRSIT accepts 
trajectory samples and their corresponding time samples tg(n), t(n)], 
and yields a smooth trajectory estimate, together with estimates of 
the velocity and acceleration at a corresponding time [r(n) , f (n) , 
f"(n), t(n)]. DIRSIT utilizes a novel approach to filtering the data 
and providing derivative estimations. This approach is known as the 
derivative smoothing technique (DST) . The nonlinear character of 
DIRSIT has made it very difficult to know what effect it has on prac- 
tical signals. This situation is relieved to some extent by this re- 
search . 

4 . 1 The Structure of DIRSIT 

A complete account of the structure of DIRSIT can be found in 
the technical memorandum No. 1004, DA Project 516-04-007, from the 
White Sands Missile Range, New Mexico, November 1962. A short, slightly 
simplified, explanation of the structure of DIRSIT will be given here. 

The conventional version of DIRSIT passed the data through an 
interval set of the form [a, b) , (b, c]. The Interval [b, c] is re- 
ferred to as the window region. The interval [a, b) is referred to as 
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the tailoff region. Roughly, DIRS IT smooths the data by assuming a 
constant second derivative over the window region such that the result- 
ing smooth data lies '*in the middle" of the raw data. In particular, 
consider a smooth estimate of the output function f (n) and its first 
two derivatives, £’ (n) and f"(n), for n = a,..., h - 1. The values of 
f(b) and f'(b) are calculated based on the previous point, b - 1. The 
value of f"(b) is then given an initial guess (probably f"(b - 1)), 

Then f (n) is calculated based on f"(n) = f"(b) for n = b + 1 c. 

If there are as many raw points above the values of f (n) as there are 
below, then the guess for f"(b) is taken to be correct. Otherwise, a 
new guess of £"(b) is obtained, and the procedure is repeated until 
the "correct" value is found. The change from f"(a) to f"(b) is then 
utilized in updating the tailoff region [a, b) so that there is a con- 
stant change in f"(n) form n = a to n = b. At this point, the data 
£(a), f ’ (a) , and f"(a) is output and the interval set is stepped for- 
ward to include a new data point at n * c + 1. 

An important feature of DIRSIT is that it smooths the data via 
the derivative smoothing technique (DST) . The DST amounts to adjust- 
ing the estimated derivative so that the resulting integrated curve 
"fits" the data. Thus, given f(b) and £'(b), f"(b) is adjusted accord- 
ing to a prespecified model (in this case, a constant acceleration over 
the window), so that the resulting f(n) "fits" the data. This tech- 
nique provides a smooth approximation to the data because the smooth 
data f(n) must be integrated (smoothed) twice from £"(n). 
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Another important feature of DIRSIT Is the method the DST util- 
izes to ”£it” the data. This method is to choose f*’(b) such that f(b) 
forms a ^median curve*’ through the raw data. This method gives DIRSIT 
a strong immunity to noise spikes. 

DIRSIT has been used in an altered form at the University of 
Utah. The basic structure is the same except that there is no use 
made of the tailoff region, i.e., the tailoff region has zero points 
In it. This author believes that more smoothing of the second deriva- 
tive could be accomplished in a much more appropriate and less arbi- 
trary manner than using the tailoff scheme. In this paper, unless 
otherwise explicitly stated, the term ’’DIRSIT” refers to this modified 
version. 

The version analyzed here assumes that the window is of length 
10 and that all data are sampled at equal intervals. This latter re- 
striction is made for ease and generality of analysis. Thus, the re- 
sults will be stated in such terms as ’’radians per sample” so that the 
results are applicable to all equally spaced sampling rates. 

4.2 The ’’Frequency Response” of DIRSIT 

DIRSIT is analyzed by the DDF developed in the previous chap- 
ters of this paper. The same conventions are used here that were used 
in the previous chapter. 

The measured DDF is plotted in Fig. 4.1. The ERF is plotted in 
Fig. 4.2, where a maximum value of 2.0 is set on the plot so that the 
relevant information is clear. From this latter plot, it is clear that 
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Fig. 4.1c. The measured DDF for DIRSIT. The phase is shown here. 
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the DDF "description" is a good one only in the range from 0.0 to 
about 0.5 radians per sample. This means that over this interval, the 
linear region, DIRS IT behaves basically like a linear filter. Thus, 
DIRSIT is basically a low-pass filter over its linear range. 

The interpretation of this data is as follows. Data with fre- 
quencies ranging from D.C. to about 0.33 radians per sample will be 
passed essentially unchanged. For input data, the Nyqulst sampling 
rate, p radians per sample, corresponds to two samples per cycle. For 
data to be passed by DIRSIT, the data are specified to be below about 
0.33 radians per sample, which correspond to about 20 samples per 
cycle. Thus, for the data to pass DIRSIT, they must be sampled about 
10 times the Nyqulst rate. Generaly, then, DIRSIT will pass a signal 
with a half wavelength of about its window length or longer. This 
analysis is all based on Fig. 4.1. 

4.3 The "Nonlinear Behavior" of DIRSIT 

A FIR realized approximation to the quasi-linearization of 
DIRSIT is obtained. Fig. 4.3 is the real part of the IDFT of the sam- 
pled DDF obtained in Fig. 4.1. The imaginary part is negligible. This 
was then tailored, i.e., truncated and extended to yield the approxi- 
mate DDIR (see Fig. 4.4). The Hamming, Hanning, and Fourier windows 
were tried to Improve the results. The Fourier window worked the best. 
Fig. 4.5 shows the plot of the approximate DDF; this is using the data 
in Fig, 4.4. 

DIRSIT is compared with its approximate quasi-linearization 
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Fig. 4.4. An approximated DDIR for DIRSIT. 
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(see Fig. 4.4 and Fig. 4.5). This is to illustrate the ”non linear" 
effects of DIRSIT. Three different inputs were fed through each sys- 
tem. The quality of each response to each input is based upon a qual- 
itative judgment of the plots of the outputs. The first input is a 
sinusoid well within the linear region of DIRSIT. The second is the 
same sinusoid contaminated with gaussian noise. And the third is the 
noisy sinusoid contaminated again with random spikes. 

The first input signal, the windowed sinusoidal, is shown in 
Fig. 4.6. The frequency distribution is plotted in Fig. 4.7. The win- 
dowing effect is clear from Fig. 4.7. The frequency of the sinusoidal 
is well within the linear region, as can be seen from Fig. 4.7 and Fig, 
4.2c. The frequency of the input is 0.1 radians per sample, or about 
20 7T samples per cycle. Thus, according to the theory thus far devel- 
oped, this signal ought to be within the "pass band" of DIRSIT. (Note 
also that the ratio of frequency to 2 tt is Irrational, so that this is 
not one of the frequencies used In measuring the DDF of DIRSIT in the 
first place.) 

Fig. 4.8 shows the output from DIRSIT. Note the output is 
nearly exactly a delayed version of the input, as expected. The first 
and second derivatives of the input each have longer respective transi- 
ent effects. The second derivative estimate (the acceleration) suffers 
a clipping effect. 

The frequency and time plots of the quasi-linear outputs are 
plotted in Fig. 4.9 and Fig. 4.10, respectively. Fig. 4.10 indicates 
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Fig. 4.5b. The approximate DDF to DIRS IT. Part 
(b) shows the magnitude (log scale) . 
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Fig, 4,6. The "first input". A windowed sinusoid with 

a frequency of 0.1 radians per cycle. This is 
the first of three Inputs run through DIRSIT. 
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Fig. 4.8c. The response from DIRSIT to the first input. 

This is an -estimate of the second derivative 
of the input signal (the first input) . 
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Fig. 4,9. The log magnitude of the response from 
the quasi-llnear approximation to the 
first input (the frequency description) . 
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that the quasi-llnearlzation passes the sampled sinusoid with a slight 
delay. Fig. 4.11 shows the difference between the output of DIRSIT 
and the qua si- linearization output. After transients, the magnitude 
of this difference is less than 0.0015, or the outputs differ less 
than 0.15 percent. 

The second input signal consists of the previous input signal, 
the sampled sinusoid, contaminated by added gaussian noise. The added 
noise has a mean of 0.0 and a standard deviation 0.1. This input sig- 
nal is plotted in Fig. 4.12. The frequency of this signal is plotted 
in Fig. 4.13. 

The response from DIRSIT to this second input is shown in Fig. 
4.14. The smooth estimate, £ (n) , of the noisy input seems to be 
affected little. However, the first derivative (velocity) shows more 
effect of the noise. Finally, the second derivative is quite irregu- 
lar and choppy. 

The frequency description and time description of the response 
to the quasi-linearization are shown in Fig. 4.15 and Fig. 4.16, re- 
spectively. Clearly, most of the noise is attenuated with a rela- 
tively good estimate of the sampled sinusoidal as an output. 

Fig. 4.17 shows the difference between the output of DIRSIT and 
its quasi-linearization. This difference, after transients, is bound 
by 0.05. This shows that, as far as the smooth estimate of the sinus- 
oidal goes, DIRSIT still behaves very much like a linear, low-pass 
filter. This result is important, since the frequency of the input 
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Fig. 4.11. The difference between the response from 
DIRSIT and the response from the quasi- 
linear approximation to the first input. 
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Fig. 4.14b. The response from DIRSIT to the second input. 

This is an estimate of the first derivative 
of the input signal (the first input). 
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Fig. 4.14c. The response from DIRSIT to the second input. 

This is an estimate of the second derivative 
of the input signal (the first input) . 
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Fig. 4.15. The log magnitude of the response from 
the quasi-linear approximation to the 
second input (the frequency description) . 
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The difference between the response from 
DIRSIT and the response from the quasi- 
linear approximation to the second input. 



function is not negligible over the nonlinear range of DIRSIT (See Fig. 
4.13). 

The third input consists of the noisy sampled sinusoidal input 
contaminated with random spikes. This is plotted in Fig. 4.18. The 
spikes are an added constant of 5.0, added in random Intervals, Thus, 
a bias is shown in the frequency description of this input in Fig. 

4.19. 

The response of DIRSIT to this input is plotted in Fig. 4.20. 

The results of this reduction compared to the results of the previous 
input is very interesting. There are two notable points. First, the 
smooth estimate of the function and its first derivative are about the 
same, and second, the second derivatives differ. The first observa- 
tion Implies that DIRSIT, as a digital filter, is practically immune 
to spikes. This immunity carries into the first derivative estimates. 
The second observation seems reasonable in light of the fact that the 
second derivative at b, f"(b), is directly dependent on the latest in- 
put value at c, while f(b) and f*(b) are both only indirectly depen- 
dent on the point at c. Thus, a sort of built in "smoothing effect" 
is in practice. This is another result of the DST. Examination of 
Fig. 4.19 and Fig. 4,13 shows the noise is much more prevalent, so 
that the quasi-linearization is expected to fair much worse. • This is 
Indeed the case as can be seen from Fig. 4.12 and Fig. 4.22. 

The quasi- linearization response to this third input shows a 
large discrepancy from both the original sinusoid and for the smooth 
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estimate of DIRSIT, The quasi- linearization is seen to be very sus- 
ceptible to the bias, whereas DIRSIT is Immune. This is also illus- 
trated in Fig. 4.23, which shows the difference between the DIRSIT 
output and the quasi-linearizatloa output. 

This latter input response difference is the main illustration 
of the power of the "nonlinear effect" of DIRSIT. It is the operation 
of DIRSIT on its nonlinear band that affords this immunity. 

4.4 Comparison of DIRSIT to Other Systems 

DIRSIT is compared with two other systems by feeding the three 
input signals of the last section through the other systems. This 
allows a qualitative comparison of DIRSIT as a discrete differentiator. 
The first system is a typical quadradic least-square fit to the data. 
This system yields the velocity and acceleration by differentiating 
the "best" quadradic curve fit. The second system is also a quadratic 
least-square fit to the data except that it uses the DST. The compari- 
son of these systems with DIRSIT will yield a good idea of what bene- 
fits there are in the DST and what benefits there are in the way DIRSIT 
"fits" the data. 

The first system is a typical differentiator that might be found 
in many program libraries. The differentiator windows the data with a 
window length of ten points. A second order polynorainal is given a 
least— square fit to the data in the window and the coefficients are 
used to estimate the smooth curve and its first two derivatives. This 
system is referred to as the "quadradic least square" (QLS) system. 
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The QLS was chosen as an example to compare to DIRSIT for sev- 
eral reasons. First, the QLS is in conanon use. Second, in terms of 
the use of DIRSIT here at the University of Utah, the QLS is DIRSIT 's 
main competition in the kind of data reduction DIRSIT is used for. 

And third, they both use the same model. They both assume that the 
third derivative of the "true" data Is zero over the window. 

The QLS system differs from DIRSIT in two important ways. 

First, the DST is not used; l.e., the smooth curve is fit to the data 
and not the acceleration. Thus, each new window is independent of the 
last one. Second, the "central tendency" is a least-square fit, which 
is much more susceptible to spikes than the median. 

The output of the three inputs of the last section are shown in 
Fig. 4.24, Fig. 4.25, and Fig. 4.26, respectively. The output for the 
first input signal of this system and DIRSIT are rather comparable. 

The smooth estimate output for the second signal already shows effect 
from the noise. The velocity and acceleration get progressively worse. 
Finally, the output for the third signal is apparently complete non- 
sense. 

This behavior is not completely surprising, since if a smooth 
signal has some contaminating noise in it, then its derivatives will 
have much more! The second system, denoted here as the quadradlc 
least square using DST (QLSDST) , may be expected to fair much better 
than the previous system on the first two inputs, since It gets away 
from differentiating noise. 
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Fig. 4.24a. The response from QLS to the first input. This is 
an estimate of the input signal (the first input). 
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^ig» 4.24b. The respoBse from QLS to the first input. 

This is an estimate of the first deriva- 
tive of the input signal (the first input) . 
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Fig, 4.24c. The response from QLS to the first input. 

This is an estimate of the second deriva- 
tive of the input signal (the first input) . 


- 77 - 



VELOCITY 


.168+01 10 



Fig. 4.25b. The response from QLS to the second input. 

This is an estimate of the first deriva- 
tive of the input signal (the first input) . 
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The output of the three inputs of the last section are shown 
in Fig. 4.27, Fig. 4.28, and Fig. 4.29, respectively. The outputs of 
the ^irst two Inputs dte much better than for the previous system and 
rather comparable with DIRSIT. The output of the third input, however, 
shows the effect of the least-square "fitting" is much more susceptible 
to spikes than DIRSIT is. 

These results characterize the two advantages of DIRSIT to QLS. 

As expected, the DST affords much better "filtering" than raw data fil- 
tering, since the differentiating of noise is avoided. Again, as ex- 
pected, the median is seen to be much less susceptible to spikes than 
least squares. 

4.5 Summary 

DIRSIT has been shown to behave much like a low-pass filter for 
signals ranging from dc to 0.5 radians per sample. Above 0.5 radians 
per sample, DIRSIT exhibits nonlinear behavior. This nonlinear behavior 
effects a "spike immunity" and smoothing to signals in the linear region 
that have been contaminated with noise. 

The "pass band" region comprises frequencies that have a half 
wavelength down to about the window length. Above this frequency, 

DIRSIT tends to reject and distort the data. Intuitively, this would 
seem to indicate that if the number of points in the window were 
changed, the corresponding "pass band" would change accordingly. This 
is Indeed the situation. A DDF was found for a form of DIRSIT that 
utilized a window length of 6, and is plotted in Fig. 4.30. The ERF 
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VELOCITY 









SfiMPLES 


Fig. 4.27c. The response from QLSDST to the first input. 

This is an estimate of the second derivative 
of the input signal (the first input). 
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Fig, 4.28a. The response from QLSDST to the second input. This 

is an estimate of the input signal (the first input). 
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SRMPLES 


Fig. 4.28b. The response from QLSDST to the second input. 

This is an estimate of the first derivative 
of the input signal (the first input). 
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SRMPLES 


Fig. 4.29a. The response from QLSDST to the third input. 

This is an estimate of the first derivative 
of the input signal (the first input) . 
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Fig, A. 29b. The response from QLSDST to the third input. 

This is an estimate of the first derivative 
of the input signal (the first input) . 
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MRGNITUOE (DB) 



Fig. 4.30c. The measured DDF for the modified 

DIRSIT. The phase is displayed here. 
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Is displayed In Fig, 4.31. These plots verify that the cutoff fre- 
quency for this version of DIKSIT IS about 12 samples per cycle, as 
predicted. This result adds a new dimension of flexibility to DIRSIT. 

The model DIRSIT uses in its DST is that the second derivative 
is constant over the window. This amounts to a parabolic "fit". 

Other models could be used as well. 

Further possibilities for Investigation of DIRSIT using the 
present methods are: 

1. A quantitative method could be implemented to Vcompare" digi- 
tal differentiators. 

2. Different models could be used to "fit" the data in a more 
appropriate manner. 

This latter method would allow the tailoring of DIRSIT to a specific 
problem in much the same way that least-square approach is used now. 

Also , if the model allowed the evaluation of the third derivative , it 
is expected that this would yield much better estimates of the signal 
and the first two derivatives, since then the third derivative would 
"absorb" the noise. 

The results, then, from this Investigation show what to expect 
of DIRSIT. DIRSIT is seen to be immune to noise to a large extent by 
virtue of its use of DST, and immune to spikes by virtue of its use 
of the "median fit". By adjusting sampling and window length, DIRSIT 
exhibits a large degree of flexibility. 
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Fig. 4.31. The ERF for the DDF of the modified DIRSIT. 
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APPENDIX I 


A VECTOR SPACE FOR DISCRETE SYSTEM ANALYSIS 

In its most general sense, a physical system may be thought of 
as the realization of a mapping from one vector space to another. This 
is termed the "input-output” point of view. This approach is valuable 
since it allows the use of the mathematical tool box of functional 
analysis. 

In the continuous case, both the input and output spaces may 
both be taken to be one of the L 2 spaces. Consider the case when the 
input is a sinusoid of period T, then assuming the output is periodic 
of period T, both spaces may be taken to be l2[0, T]. An advantage to 
this approach is that L2[0, T] is a dense Hilbert space. That means 
that the function space may be spanned by a countable set of functions; 
i.e., any output may be expressed as an infinite series of any one of 
numerous countable bases sets. In particular, one very useful such 
basis set is the Fourier series, which allows all the familiar harmonic 
analysis techniques to be used. This Fourier theory implies that the 
response of a system to a sinusoidal input consists of the fundamental 
component (the best linear approximation) and the various harmonics. 

In general, a countably infinite number of harmonics are possible. 

This theory would, in turn, allow various filters to be used to "mea- 
sure” the simisoldal-describing function for an appropriate system. 

The discrete case is more difficult. If a sinusoidal is sam- 
pled in such a way that the ratio of the sampling frequency to the 
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sinusoidal frequency is rational, the input and output sequences would 
then be periodic of some period, say N. In this case, the input and 
output spaces could be taken to be the space. As in the con- 
tinuous case, ^2^^^ ^ Hilbert space and Fourier theory applies. 

The basis set for this case could be exp(jk2r/N) for k = 1,..., N. The 
output of a discrete nonlinear system could contain only a finite num- 
ber of harmonics, since N] is finite dimensional. 

If, however, the input sinusoidal Is sampled in such a way that 
the ratio of the sampling frequency to the sinusoidal frequency is 
irrational, then the resulting sequence is not periodic. In this case, 
the input and output vector spaces must somehow contain all entries 
from negative infinity to positive Infinity. The vector space used in 
this case cannot be a ^2 since it can contain no interesting vec- 

tors. In particular, the input sampled sinusoid Is not contained in 
^ 2 * Some other space must be devised to allow the treatment of non- 
periodic, nontrivial sequences, preferably in such a way that for peri- 
odic sequences, the space reduces to an appropriate space. 

Consider the set A consisting of all complex sequences such that 

litn J x(n) x(n)* (AI.l) 

n=-N 

is finite. The set A, together with the operations of addition and 
scalar multiplication as defined in the space, is a vector space. 

The vector space becomes almost a pre-Hilbert space with the intro- 
duction of the inner product 
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(AI.2) 


for any x and y in A. The vector space V that is pre^Hllbert is a 
slight variation of A. V consists of almost all the vectors of A, 
except that if two vectors in A differ only at a few points, then 
they are considered the same vector in V- Formally, this amounts to 
the quotient space generated by the sub space consisting of all the 
vectors where Eq^ AI*1 is zero* These concepts are examined more 
closely In Luenberger [3]* The Important point is that if a compari- 
son of two different vectors in V is made based on a comparison of two 
corresponding vectors in A, a region of the vectors in A must be se- 
lected such that they are representative of the vectors in V. The 
point here is that it is necessary to avoid regions that might contain 
finite duration transients* 

An important property of the rsulting space V is that it is not 
separable. To see this, it is only ncessary to note that the two vec- 
tors exp(jwn) and exp(jw^n) are orthogonal, whenever w and w^ are dif- 
ferent. But there are an uncountable number of these vectors, one for 
each real number w. Thus, there is an uncountable set of mutually 
orthogonal vectors contained in V, so that no countable basis set could 
span the entire space. The significance of this result from the engi- 
neering standpoint is that there could very possibly be an output of a 
system that was orthogonal to every term of some appropriate Fourier- 
type expansion, so that no anlysis from that standpoint is possible! 
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Another important result Is that» for the case where the se- 
quences are periodic of period W, the vector space V is Isomorphic 
to N]. This may be seen by noting that 

N ^ 

(x, y)^ = lim ij - I x(n) y(n) 

N-+® n=-N 

M - kN+N-1 

= M ^ N i 

k=-M n=kN 
- kN+N-1 ^ 

' ” JkK 

where it is assumed that n = kN,,**, kN + N - 1 is a "representative 
region". 

Finally, V contains the vectors of interest. Any sampled peri- 
odic function is in V, as well as many sampled nonperiodic functions. 
The vector space V, as has here been briefly presented, is useful to 
handle nonperiodic as well as periodic discrete input-output system 
relations* 
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APPENDIX II 


THE 5-T^S METHOD 

The 5-T’s method is utilized to realize a finite impulse re- 
sponse (FIR) approximation to a discrete system that has a specific 
frequency specification • The method consists of guessing the FIR 
of the system in an intelligent way. 

The problem may be stated as follows. Given samples of the 
frequency response desired, find a FIR with the desired frequency re- 
sponse to within some specified tolerance to realize an approximation 
of the desired system. In some cases, the problem may be to realize 
a FIR approximation to a filter specified by a continuous frequency 
description. In fact, a practical filter cannot be given a continuous 
distribution in general, since it would require an ink of width zero! 
Thus, In all but ’’textbook*’ examples, the frequency description is 
given by discrete samples. The case considered here is when these 
samples are evenly spaced from 0 to 2 tt. The problem is to guess an 
appropriate FIR. 

Whatever the ’’real” system is, it has a specific unique impulse 
response h(n). In almost all practical cases, h(n) is infinite. Sup- 
pose h(n) is available exactly. Then the problem is to select a finite 
nonzero sequence k(n) with approximately the same frequency response as 
that of h(n). Intuitively, the larger values of h(n) seem most Impor- 
tant, so that if these values are selected out via a window w(n), then 
the response of the result may be very close to the desired result* 
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This Is the intuitive explanation of windowing from the time domain 
point of view. 

From a frequency point of view, there is some frequency descrip- 
tion of h(n), viz*, HCs) - E' [z - exp(jw)]* Similarly for w(n) , W(w) = 
W^[z = exp(jw)]. The frequency description of k(n) “ h(n) w(n) is pro- 
portional to H(w) * W(w), where ***** indicates convolution in the com- 
plex domain* So that if the window w(n) is to produce a FIR without 
substantially disturbing H(w), then W(w) ought to be nearly an impulse* 

The problem Is that h(n) is not available* Only samples of H(w) 
are available* However, a sequence k(n) containing only a finite set 
of nonzero values is available. This sequence has the same frequency 
description as h(n) at the sample points in the frequency domain. This 
k(n) is the IDFT of those available samples. 

Thus, the 5-T*s method consists of the following steps* TRANS- 
FORM the samples of the frequency description into the time domain. 
TRUNCATE the samples if a sample number limitation exists. TAILOR the 
samples via a window* TRANSFORM the resulting set back in the fre- 
quency domain. And TEST the results to see if it meets the specifica- 
tions . 

The windowing is a bit tricky* A discontinuous wondow will dis- 
play the Gibbs phenomenon, so that it is a good idea to use a continu- 
ous one. The specific window used depends on the specific application. 
Note that no window is not possible; since there is a finite set of sam- 
ples, the selecting of them implies at least a Fourier window* Before 
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transforming back Into the frequency domain, it is necessary to aug- 
ment the time sequence by a factor of 2 or 4 in order to get an ade- 
quate description of the results (not just at the original sampling 
points) . 

This appendix is meant as a short description of the 5-T's 
method and the reader is referred to the appropriate references for 
further details [6], 
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